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ABSTRACT 

The special education program of Ozanam Home for 
Boys, Inc. (Kansas City, Missouri)/ a private residential psychiatric 
facility serving about 60 emotionally disturbed adolescent males, was 
examined. Detailed eco-behavioral data were collected on a sample of 
one "active" student, one "passive" student, and two controls. Data 
for all four students showed that the most frequently occurring 
composite throughout observed lessons was active academic response, 
followed by passive response and competing behaviors. The entire 
population of 70 students and 15 teachers was queried concerning 
satisfaction with the program. Students frequently praised the 
teachers for their help and reported progress academically, 
beliaviorally, socially, and emotionally. Teachers reported student 
academic progress, support from the administration / and an overall 
pleasant school atmosphere. Achievement data from past cohorts (N=73) 
showed a weak, trend in gain scores from pre-test to post-test. The 21 
out of 79 former students who were able to be contacted appeared to 
be functioning at an average level. The evaluation report concludes 
with seven bibliographic references, observation code definitions, 
and copies of the student and teacher questionnaire. (JDD) 
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EXECUTIVE SUMMARY 

During the spring semester of 1988, Ozanam's special 
education program was examined comprehensively in order to 
determine what was most effective, valuable, des^irable, or 
useful with the expectation that the information obtained 
would be used by those in charge to plan future 
intervention strategies. Multiple methods were used as a 
means to reduce shortcomings inherent in each method, thus 
better triangulating on what might be successful or what 
might need to be modified* 

Detailed e co-be h a v i o r a 1 data were collected on a sample 
of four students using the Code for Instructional Structure 
and Student Academic Response (CISSAR) (Stanley & 
Greenwood, 1981)» Two "types" of students were deemed of 
special interest due to their frequency in the classrooms* 
One "type" of student observed was relatively "active," one 
relatively "passive," and two served as controls (their 
"type" was unknown to the observers)* Observations were 
conducted by two observe i:s trained to use the 
Gco-behaviora 1 codes* Observers were not allowed to 
collect "real" H-^a until they had demonstrated good use of 
the codes and showed good inter-observer reliability of 80% 
or better* 

The eco--beha vioral data were collected across several 
lessons throughout various times of the school day* The 
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data fct all four students showed that tliroughout every 
observed 3esson, the roost frequently occurring composite 
was active academic response, followed by p.assiye response 
and competing behaviurst These findings appear to indicate 
effective instructiont Generally, instruction is more 
effective when the percentage of active academic response 
is higher tlian percentages of passive response and 
competing behaviors. 

The entire population of students (N-70) and teachers 
(N-15) were queried* All in all, the responses to the 
questionnaires Indicated general satisfaction with the 
program by all involved. No major discrepancies were 
encountered between students* and teachers' perceptions* 
Students frequently praised the teachers for their help and 
reported progress academically, be h a v i o r a 1 ly , socially, and 
emotionally. Teachers reported student academic progress, 
support from the administration, and an overall pleasant 
school at mo sphere. 

Achievement data from past cohorts (N=73) showed a weak 
trend in gain scores from pre-^tost to post-test. There 
were few valid cases available for 1985, preventing 
generalizations. There was an extreme range of number of 
months between initial testing and final testing for 1986, 
clouding the results. T,he data for 1 987 showed very 
encouraging results. 
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Unfortunately, this researcher was able to reach only a 
few former students (21 out of 79) to check on their 
current occupational and educational levels. Those few who 
were contacted appeared to be functioning at an average 
level* 

The overall impression one gathers from the findings is 
that of a successful program. For the most part, the 
special education program at Ozanam Horne for Boys appears 
to be running quite well, offering a quality education with 
equity for all students. There are areas of concern, 
though, that need special attention. Recommendations were 
offered in that vein. 
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EVALUATION OF OZANAM^S SPECIAL 
EDUCAllOW PROGRAM 

PROGRAM DliSCRIPTlON 
Oznnnm Home for Boy;;, Inc., is n private residential 
psychiatric facility serving tlie emotionally disturbed 
adolescent male between 12 and 18 years of ape* At present, 
Ox an am serves about 6 0 boys in its residential treatment 
program. Oxanam provides an appropriate formal education 
program to meeL the needs of all boys in residence- This 
program ran be divided into two sections: 1, the formal 
public school program, and 11, the special education 
program at Ozanam. 
!• Public School Progtam 

All boys who are emotionally and academically capable may 
attend the public school, provided the public school is 
capable of meeting the tlierapeutic goals set up for the 
individual boy. 

11. Ozanam's Special Education Program 

Generally, if a boy's educational and testing records show 
learfiing disabilities, educational gaps, or severe behavioral 
problems, he is placed in the special education program at 
Ozanam. This program is accredited tli rough the Independent 
School Association of Central States for grades one through 12 
and is op proved by the State Board of Special Education. The 
program employs teachers with Missouri teaching certlflcntes 
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and ce r t i £ 1 ca c i o n In behavioral disorders. 

PURPOSE, GOAL, AND OBJECTIVES OF THE PROGRAM 

The purpose of the special education program is to provide 
an educational and therapeutic atmosphere for those boys whose 
academic and emotional needs are not being met in a regular 
school settjngt The goal of the program is to strengthen a 
boy's academic and social weaknesses while encouraging his 
academic interests, thus preventing possible future placement 
in an institution. The objectives of the program are: 

1« Increase academic performance^ 

2« Develop positive attitudes toward school. 

3. Develop consistent study habits. 

A. Prevent school drop-^outs. 

5# Prepare for vocational programs. 

6. Prepare for G.E.D*. 

7. Prepare the boy emotionally and behaviorally to return 
to regular classes* 

PURPOSE OF THE EVALUATION 
The purpose of this evaluation is to examine 
comprehensively the special education program at Ozanam in 
order to determine v^hat is most effective, valuable, 
desir£»ble, or useful. In other words, this report attempts 
to measure how successful the program has been in attaining 
its stated goal. Note that this evaluation has its focus 
on the special education program at Ozanam* The formal 
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public school program is not included in the evaluation. 

This is the first time that the special education program 
has been examined comprehensively. Two other evaluations were 
previously conducted at Ozanam; one dealt with follow-up of 
former residents (Archer, 1985), and another dealt with 
characteristics of incoming residents (DeSouza, 1987)» 

RATIONALE OF THE EVALUATION 

The rationale for conducting a program evaluation of this 
magnitude is to assist those in charge in the processes and 
analyses of the program* An etiological approach to program 
evaluation is included in order to assess program variables 
and program outcomes in th 2 context of a person-environment 
fit; specifically, the intent is to apply an eco-be havio ral 
Interaction to the assessment of ongoing classroom 
Ins t ruction. 

THE ECO-BEHAVIORAL APPROACH 
The eco"-behavioral approach was developed at the Juniper 
Gardens Children's Project, located in Kansas City, Kansas^ 
This approach rests on the premise that ^nudents' interactions 
with environmental (or ecological) factors either optimize or 
limit their performance (Greenwood & Carta, 1987)» The work 
done at Juniper Gardens resulted In the development of an 
instructional technology based upon the above principles* 

Such instructional technology has been successfully 
implemented In schools in Minneapolis (Greenwood, Delquari, & 
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Hall, 198^) and Kansas City, Missouri (Nelson, 1986). With 
some modifications, the eco-be ha v io ra 1 system appears very 
suitable to evaluate the special education program at Ozanam 
which has as its goal the amelioration of academic 
retardation. The boys at Ozanam already function at lower 
academic levels than do their peers at the regular schools, 
thus making it essential that instruction enables these boys 
to perform academically at high frequencies over the school 
day and their entire school career. These students must learn 
more and at a faster race to obtain achievement levels 
comparable to more advantaged students. The intent of an 
eco-behavlor. al approach to instruction is to contribute 
maximally to increasing rate and duration of academic response 
in the classroom which reflects the intent of the goal of 
the program (Greenwood, Delquari, & Hall, 1984). 

EVALUATION DESIGN 
The evaluation of the special education program is 
designed around four outcome areas. The corresponding outcome 
measures will provide decision makers with evidence regarding 
the progress being made toward achieving the program's 
obj ectives » 

(1) Ecological /Behaviora 1 outcomes 

Ecological/behavioral measures will be collected via 
the eco-behavioral approach using the Code for 
Instructional Structure and Student Academic Response 
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(CISSAR) (Stanley & Greenwood, 1981), which measures the 
level of student acadetnlc engagement in the context of 
different instructional arrangementn.. 

(2) Perceptual outcomes 

Perceptual measures will be collected through the use 
of student and teacher questioiinaires regarding their 
perceptions of the quality of instruction being offered at 
Oz a nam « 

(3) Achievement outcomes 

Achievement raeasure^i will be collected via archival 
data from past cohorts for math, spelling, reading 
recognition, reading comprehension, general Infcrmacion, 
and total score from the PI AT (Peabody Individual 
Achievement Test) administered at the time of admission and 
discharge. Additionally, intelligence quotients will be 
collected via archival data from past cohorts for WISC-R 
(Wechsler Intelligence Scale for Children - Revised) 
verbal, performance, and full scale scores tid mi n i s t e red at 
the time of admission and discharge. 
(A) Educational Follow-up outcomes 

Foiiow-up measures via telephone interviews with family 
members of former residents will be conducted using a 
follow-up form developed by Archer (1985) in order to 
assess how former students are faring o c c up a t i ona 1 ly and 
educationally after discharge from Ozanam. 
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RVALUATICN QUIiSTlONS 
The er.o-behavloral approach to proRram evaluation ca*i 
provide those in charge with information about, the school 
climate by measurlRg the aggregate effect of , the , program ' s 
ecology (physical and material aepecis), milieu (social 
dimensions regarding the presence of persons and groups), and 
social system (the relationship of persons and groups). Thus, 
Information about classrooms ^ind teaching strategies can be 
most helpful in arranging more effective instruction. It can 
provide answers to the following questions? 

1. What types of activities are taking place as part 
of the program? 

2. Does participation in the program have any impact 
on the student? 

3. What are the best ways to arrange the clasfjtoo.r. 
environment^ e.g., use of activities, materials, 
instructional groups, to optimise particular forms 
of performance? 

4. How can modifications in instructional practices 
influence student behavior? 

5. What are the promoters of these behaviors? 
Additionally, this report addresses the following 
evaluation questions: 

6. What have been the longitudinal trends, e.g., gain 
scores, of PIAT nnd WISC-R scores? 
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7* What are the perceptions of teachers and students 
regarding the effectiveness of the program? 

8. How are former students faring educationally and 
occupationally after discharge? 

METHOD 

Information foe this evaluation was gathered in several 
ways: direct classroom observation, student and teacher 
questionnaries co assess their perception of the program, 
achievement scores to asses possible gains from past cohorts, 
and follow-up of former students. The evaluation procedures 
follow belowt 
Cla g sr ooro observation 

Classroom observations were conducted during the period 
from February, 1988, through May, 1988, using a code developed 
at the University of Kansas called C13SAR (Code for 
Instructional Structure and Student Academic Response) 
(Stanley & Greenwood, 19bl). Among other things, the CISSAR 
measures the amount of active academic responding in a 
classroom, which is equivalent to academic learning, and 
assesses the occurrence of ecological events and student 
behaviors closely associated in time. 

Observations were conducted by two t rained observers. 
In ter -observer reliability was computed by comparing the 
records of the two observers who s i rou 1 1 an eoi» s 1 y but 
Independently recorded the same phenomena. Only after the 
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Observers had achieved six consecutive reliability checks of 
80% or better had adequate use of definitions been 
demonstrated. The observers maintained an excellent level of 
Inter-observer reliability (100% for not-checked cells and 96% 
for checkec cells) throughout the assigned period for 
classroom observations. 

For each lesson that was observed, the observer coded 
instructional processes relative to three types of student.: a 
passive student, a behavioraliy active student (both selected 
by Che tea-her), and two students randomly selected by the 
observers as controls. The observers observed these four 
target students for 20 minute blocks, unless there was a new 
activity or a prolonged interruption which resulted in a new 
observation block. Every 15 second interval, the observer 
"panned" across the room, recording what was happening in two 
observation categories simultaneously (student behavior and 
task/material). The specific variables coded within these two 
categories are listed in Table 1. Ad d i ti on a 1 ly » class size, 
activity, and primary group were recorded at the beginning of 
each observation block. 

The eco-behavioral data presented in this report are 
called momentary time sampling. This type of observation 
datura is analor,u;is to taking a photograph of the 
instructimal process every 15 seconds (these are referred 
to as observation points in this report). By putting this 
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Table 1 

Observation Code Definitions- 
1. Student Responses 

(A) Student Behavior Category - Active Response , 
W Write 

TP Task participation 
RA Read aloud 
TA Talk academic 
RS Read silent 

(B) Student Behavior Category ~ Passive Response 
AT Attending to task (not actively engaged) 
OA Other appropriate (not academic) 

(C) Student Behavior Category - Inappropriate Behavior 
LA Looking around 

D Disruptive 

01 Other inappropriate ' 
II. Task/Material Codes 
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RR 


Readers 
• 


WB 


Workbook 


WS 


Worksheet 


rp 


Paper /pencil 


LL 


Listen to lecture 


OH 


Other media 


TSD 


Teacher-student discussion 


SSD 


Student-student discussion 


FP 


Fetch/put away 


NM 


No materials 
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series of "photographs** together, Inferences can be made 
about the relative frequency of occurrence of each variable 
in the code* Also, conditional probabilities can be 
calculated, based on the observation data, that allow one 
to estimate the probability of a particular response, given 
the presence of specific instructional materials^ In sum, 
this system provides a means of examining the percentage of 
time in which a student uses various tasks and materials 
during a specific instructional activity and to determine 
how the student responded in relationship to each 
particular task. 

Table 1 shows the specific variables codes used in the 
Ac t I vi ty /Task/Be havi 0 r Matrix (see Appendix A; note the 
codes for student behaviors)* Because the student 
responses are mutually exclusive, e»g#, not coded in 
combination, their frequencies are additive* This allows 
the creation of three composites from the student response 
variables* These are: (A) "active academic responding*' 
composite; it includes writing (W) through reading silently 
( RS ) ; (B) **passive responding** composite; it includes 
attending to task (AT) and other appropriate (OA); and ( C) 
'•competing responding '* (inappropriate behaviors) 
composite; it includes looking around (LA) through other 
inappropriate (01)* 
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Perception of teachers and student s 

Perceptions of the program were collected via end-of- 
semester questionnaires (see Appendices B and C)* The 
*»ntire population of students (N-«70) and teachers ( N- 1 5 ) were 
queried. Responses to open-ended questions were tallied and 
are briefly summarized in this report* The questionnaires 
focused on perceptions of Instruction and satisfaction with 
the program, which may provide an indication of how the goals 
of the program match the perception of students and teachers* 
Achievement data 

Achievement data were obtained from school records of 
those students discharged between January, 1985, and 
December, 1987* During that period, 73 boys were 
discharged* School relcords provided PIAT test srores for 
math, spelling, reading recognition, reading comprehension, 
general information, and total score* Additionally, the 
school records contained WISC-R scores for verbal, 
performance, and full scale intelligence quotients* 
Follow-up of former students 

The files at Ozanara Home for Boys were used to extract the 
nam^^s of all boys who had been discharged between January, 
1984, and December, 1986. During that period, 79 boys were 
discharged. Out of the 79 cases, contacts were made with a 
member of the family (usually one of the parents) for 23 
cases* Two family members refused to participate, leaving 
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a remaining of 21 contacts who agreed to participate in the 
study. Table 2 shows the percentages of successful cases, 
by year. A sizable pool of former students were unable to 
be contacted because of a change of address, and telephone 
information revealed no listing. The follow-up consisted 
of a telephone interview with a family member of the former 
student who supplied the following information: number of 
jobs the former student has held since discharge, education 
received since discharge, and current rate of occupational 
and educational functioning. 

RESULTS AND DISCUSSION 
Classroom observation 
A. "Active" srudent 

Figures 1 and 2 display overall data for 2A35 observation 
points (over 10 hours of direct classroom observation). The 
overall school climate consisted of small classes with an 
approximately 9:1 s t u de n t / t e a c he r ratio. The classroom 
structure consisted mainly of entire group (97%); Individual 
instruction was observed 3% of the time. The activity, 
subject area or topic of instruction during observation, 
consisted of math (26%), motor skills (26%), language (20%), 
reading (U%), social studies (6%), arts & crafts (6%), and 
spelling ( 2% ) . 

Figure 1 shows the relative frequencies of che different 
student responses occurring during these activities. An 
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Table 2 

Boy.-s Discharsed Between January, 198A and December, 1986 



1986 19 
1965 2A 
1984 36 



TOTAL 79 



er|c ^ 



YEAR TOTAL N SUCCESSFUL N % 



26% 



19% 



21 27% 



Figure 1 
Classroom Observation of 
Student Responses in 
High School Special Education 



Task Fartcipaticn 




Figure 2 
Classroom Observation of 
Tasks and Materials in 
High School Special Education 




^ Twl Thejse task3/n^a^e'*i°^3 correspond to Figure 1. 
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examination of Figure 1 indicates that the most frequently 
occurring student response was task participation (TP), which 
was observed at about 26% of the observation points* 
Attending to task (AT) was the next most frequent response at 
about 22% of the o'oservation pointSt Note that reading aloud 
(RA) occurred only about 1% of the time, which is not unusual 
for high school age children* 

Tlie composites from the student response variables for 
Figure 1 indicate that approximately 60% of the observed 
student responses were active academic responding, 2A% were 
passive responding, a^nd 16% were competing or inappropriate 
responses. Of special note is the fact that 60% of the 
observed atudent responses were active academic responding, 
which is a very good indication that this student was 
actively involved in instruction and not passively engaged 
or involved in conipeting behaviors^ 

Figure 2 shows the relative frequencies witli which the 
different instructional tasks were observed* It can be 
seen that readers (RR) were used most frequently during 
approximately 28% of the time. No materials (NM) and 
paper/pencil (PP) were the next most frequently used 
materials, each observed 20% and 17%, respectively* 
Worksheet (WS), listen to lecture (LL), other media ( OM ) , 
teaclier--student discussion (TSD), student'-student 
discussion (SSD), and fetch /put away (FP) were each 
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observed during less than J0% of observed instruction* 

Table 3 shows the conditional probabilltps that allow one 
CO estimate the probability of a particular response, given 
the presence of specific instructional materials. It can be 
seen that when readers (RR) are used, there is an approximate 
28% probability that reading silenty (RS) occurs. When 
worksheets (WS) are used, there is a 37% probability that 
writing (W) occurs* When paper/pencil (PP) are used, there is 
a 7 5% probability that writing (W) occurs. When listen to 
lecture (LL) occurs, there is an 82% probability that 
attending to task (AT) occurs as well. When other media (OM) 
is used, there is a 68% probability that writing (W) occurs* 
Whet: the task is teacher-student discussions (TSD), there is a 
64% probability that talking academic (TA) occurs. When the 
task is student-student discussion (SSD), there is a 39% 
probability that other inappropriate (01) occurs. Finally, 
with no materials (NM), there is a 78% probability that task 
participation (TP) occurs. 
B. Passive student 

Figures 3 and A display overall data for 2311 observation 
points (almost 10 hours of direct classroom observation). The 
overall school climate consisted of small classes with an 
approximately 7:1 s tude n t / tea che r ratio. The classroom 
structure consisted primarily of entire group (97%); 
individual inetructicn was observed 3% of the tirne^ The 
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Table 3 
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Conditionsil Probabilities by ceil 
Given a task, what is the behavior? 

Activity Codes 
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0% 
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0% 


0% 


o 
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2% 


0% 
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6% 
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Lire 3 

Student Responses in 
High School Special Education 



Read Aloud 1% 
Talk Academic 10.9% 



Task Participation 20.8% 



Read Silent 28.7% 




Write 9.9% 



Other Inappropriate 
Looking Around 2% 
Other Appropriate 4% 



Attend to Task 18.8% 



PASSIVE" STUDENT 



Figure 4 
Tasks/Materials in 
High School Special Education 

Paper/Pencil ^^^^^ Tvorkbook 8% 
Listen to Lecture 15% ./iM ^feb.. 



Other Material 18% 





" Fetch/Put Away 3% 
Student-Student Discussion 7% 



No Materials- 12% 



Teacher-Student Discussion 13% 



THESE TASKS/MATERIALS CORRESPOND TO FIGURE 3. 
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activity, subject area or topic of instruction during 
observation, consisted of social studies (39%), science 
(39%), motor skills (16%), language (3%), and reading (3%). 

Figure 3 depicts the relative frequencies with which 
different student responses were occurring during these 
activitiest An examination of Figure 3 shows that the most 
frequently occurring stuUent response was reading silently 
(RS)» which was observed 29% of the time* Task participation 
(TP) and attending to task (AT) were the next most frequently 
made responses, each observed about 21% and 19%, respectively. 
Again, reading aloud ( RA ) occurred only 1% of the time, which 
Is not uncommon for older children* 

The three response composites indicate that approximately 
71% of the time the student was actively engaged in academic 
responding. Passive responding occurred 23%, and competing 
behavior occurred only 6%* Of special interest is the high 
rate of academic engagement and the very low rate of 
Inappropriate behaviort Such a picture indicates that the 
special education program seems to be very effective with this 
student* 

Figure A depicts the relative frequencies with which the 
different instructional tasks/ ma terials were observed* It can 
be seen that a cluster of t asks / ma L e r 1 a 1 s had high occurrence* 
Other media (OM) was the most frequently observed material, 
18% of the time, followed by listening to lecture (LL) 15%* 
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Readers (RR) and t e a c he r -s t ud e n t discussion (TSD) were each 
observed about 13% of the time, and no materials (NM) about 
12%. Workbook (WB), worksheet (WS), paper/pencil (PP), 
Student-Student discussion (SSD), and fetch/put away were each 
observed less than 10% of the time* 

Table 4 shows the conditional probabilities that allow one 
to estimate the probability of a particular response, given 
the presence of specific instructional materials. It can be 
seen that when readers (RR) are used, there is an approximate 
87% probability that reading silently (RS) occurs. When 
workbook (WB) is used, there is a 66% probability that reading 
silently (RS) occurs. When worksheets are used, there is a 
A7% probability that writing (W) occurs. When paper/pencil 
are used, there is a 59% probability that writing (W) occurs. 
When the task is listening to lecture (LL), there is a 49% 
probabililty that attending to task (AT) occurs* When other 
media (OM) is used, there is a 35% probability that task 
participation (TP) occurs. When the task is t e ac he r - s t ude n t 
discussion (TSD), there is a 56% probability that talking 
academic (TA) occurs. When the task is s t ud e n t -s t ud e n t 
discussion (SSD), there is a A 3% probability that talking 
academic (TA) occurs. When the task is fetch/put away (FP), 
there is an 86% probability that task participation (TP) 
occurs. With no materials (NM), there is a 91% probability 
that task participation occurs (TP). 
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Given a task, what is the behavior? 
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C. Concrol studencs 
Con c: ro 1 ( a ) 

ContL-ol (a) refers to the student who was observed in 
the same classes that the "active" student had. 

Figures 5 and 6 show the relative frequencies of the 
different student responses and t a s k / ma t e r i a 1 s that occurred 
during classroom observations. The data were collected for 
nil observation points (almost five hours of direct 
classroom observation). The overall school climate consisted 
f small classes wiCM an approximately 9:1 s t ud e n t / 1 e a c h e r 
tio. The cldssi-oom structure consisted entirely of entire 
group (100%;. The activity, subject area or topic of 
instruction during classroom observation, consisted of 
language (34%), math (20%), spelling (13%), reading (13%), 
social studies (13%), and motor skills (7%). 

Figure 5 shows the distribution of student responses 
bserved during the above activities. It can be seen that 
ctending to task (AT), 28%, and writing (W), 27%, were the 
laosi:: frequently observed responses. The three response 
cottiposices were: (D active academic responding, 58%; (2) 
passive, 30%; (3) competing behavior, 12%. Again, it is 
mueiesting to point out that active academic responding was 
observed almost 60% of the time, while passive and competing 
behavior combined accounted for slightly over 40%. 

Figure 6 shows the distribution of the different 
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Figure 6 
Tasks/Materials in 
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Worksheet 16? 



or 
o 



Paper/Penci 




Readers 



23% R 



25% 




I/O 



Listen to Lecture 13% 



No Materials 5% 

Fetch/Put Away 31 
Student-Student Discussion 5% 

Teacher-Student Discussion 10% 



THESE TASKS/MATERIALS CORRESPOND TO FIGURE 5. 
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instructional tasks. An examination of Figure 6 indicates 
that the most frequently occurring task was paper/pencil 
(PP), which was observed at about 25% of the observation 
points. Readers (RR) were the next most frequent material 
used at about 23% of the time, followed by the use of 
worksheets (WS), 16%, and listen to lecture tasks (LL), 
1 3%. 

Table 5 shows the conditional probabilities that allow 
one to estimate the probability of a particular response, 
given the presence of specific instructional materials. An 
examination of Table 5 indicates that when readers (RR) are 
used, there is a 50% probability that reading silently (RS) 
occurs. When worksheets (WS) are used, there is a 38% 
probability that writing (W) occurs. When paper/pencil 
(PP) are used, there is an 81% probability that writing (W) 
occurs. When the task is listening to lecture (LL), there 
is a 79% probability that attending to task (AT) occurs. 
When other media ( OM ) is used, there is a 100% probability 
that reading silei.tly (RS) occurs. When the task is 
teacher-student discussion (TSD), there is a 66% 
probability that talking academic (TA) occurs. When 
student-student discussion (SSD) occurs, there is a A4% 
probability that talking academic (TA) occurs. When 
fetch/put away (FP) occurs, there is a 97% probability that 
task participation (TP) occurs. With no materials (NM), 
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Table 5 

Conditional Probabilities by cell 



I I 



Given a task, what is the behavior? 
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The ''ERR^* in the conditional probability cells means that the 
program was asked to calculate a percentage by dividing into a 



« 




student 
High School 



ure / 
onses 




n 



Special Education 



Task Participation 2% 
Talk Academic 6.9% 



Read Silent 12.9% 




Write 30.7% 



Attending to Task 30.7% 



Other Inappropriate 4% 
Disruptive 1% 



Looking Around S.9% 
Otlier Appropriate 3% 



U) 
U) 



ERIC 



CONTROL 



'\0 



Figure 8 
Tasks/Materials in 



gh Schoo 



Specia 



Education 



Worksheet 12% 



Paper/Pencil 




Readers 



li 29% ii), 



\ 29% «:7^fe^'/Wf Materials 6%^ 

Fetch/Put Away 'l% 
Student-Student Discussion 6% 

Teacher-Student Discussion 6% 
Listen to Lecture 1 1 % 




J}. 



These tasks/materials correspond to Figure 7. 
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there Is a 90% probability that test participation (TP) 
occurs* 

Con t ro 1 ( b ) 

Control (b) refers to the student who observed in the 
saroe classes that "passive" student had* 

Figure 7 and 8 show the relative frequencies of the 
different student responses and t a s k /raa t e r i a 1 s that occurred 
during classroom observations* The data were collected for 
1533 observation points (almost 6-1/2 hours of direct 
classroom observation)* The overall school climate consisted 
of small classes with an approximately 10:1 s t u de n t / t e a c he r 
ratio* The classroom structure consisted entirely of entire 
group (100%)* The activity, subject area or topic of 
instruction during classroom observation, consisted of 
language (AQ%), math (30%), reading, (20%), and motor 
skills ( 10%) * 

Figure 7 shows the distribution of student responses 
observed during the above activities* An examination of 
Figure 7 indicates that writing (W) and attending to task 
(AT), each observed 31% of the time, were the most 
frequently observed responses* The three response 
composites were: (1) active acadnmlc responding, 52%; 
(2) passive, 3A%; (3) competing behavior, W*%. It is 
interesting to note that just over half the total student 
responses were active academic responding, indicating a 
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TO me what lower rate of active academic responding and a 
somewhat higher rate of passive responding than the other 
.ree students • 

Figure 8 shows the distribution of the different 
Instructional tasks. It can be seen that the most 
frequently occurring tasks were readers (RR) and 
paper/pencil (PP)» each observed 29% of the time. 

Table 6 shows the coiidltlonal probabilities that allow 
one to estimate the probability of a particular response, 
given the presence of specific instructional materials. An 
examination of Table 6 indicates that when readers (RR) are 
used, there is a 41% probability that reading silently (RS) 
occurs. When the tasks are worksheets (WS) and 
paper/pencil (PP), 57% and 7 2% of the time, respectively. 
Is spent writing (W). When the task is listening to 
lecture (LL), there is an 89% probability that attending to 
task (AT) occurs. When other media (OM) occurs, there is 
a 100% probability that reading silently (RS) occurs. 
When the tasks are teacher-student discussion (TSD) and 
student-student discussion (SSD), the probability of 
talking academic (TA) Is 68% and 41%, respectively. When 
fetch/put away (FP) and no materials (NM) occur, the 
probability of writing (W) is 6 5% and 41%, respectively. 

By examining the results obtained in this study (which 
was based upon a small sample of four students over several 
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Table 6 



Conditional Probabilities by cell 
Given a task, what is the behavior? 

Activity Codes 
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The "ERR" in the conditional probability cells means that the 
program was asked to calculate a percentage by dividing into a 0* 
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activities) with those o.C past studies, e*gt, Greenwood, 
Dr-quarl, & Hall (198A)> insight can be gained of where 

anara presently stands ^ and where it may wish to be. 
oreenwood, Deiquari, & Hall, in one of t he 1 r * i ni d 1 a 1 
results in inner--city classrooms, indicated that while 7 5% 
o£ the day was devoted to instruction in academic subjects, 
only 25% of the day was spent in active academic 
responding; writing composed 16% of the day, and reading 
silently 3%. At O^anam, 60% of the data were within the 
active academic composite; writing composed 21% and reading 
silently, 

Reading silently appears to occur more frequently at 
Ozanara than in inner - city classrooms* However, it can be 
iraprovedt One of the foci o I; the eco--behavioral approach 
is on the opportunity to respond. Traditionally, a student 
may spend an entire school day just staring at the teacher 
or at some acadt^mic material. Greenwood, Delquari, fit Hall 
{198^) states that the opportunity to respond implies the 
use of instruct i. onal actios that involve presenting, 
questioning, and correcting so that all students in the 
classroom have the opportunity to practice the desired 
responses* Such instructional tactics involve active 
responses, such as v;riting, oral reading, academic talking, 
asking questions^ answering questions, and academic games 
or tasks* Passive responses include looking at or watching 
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the teacher lecture, watching an overhead transparency 
presentation, raising hand, waiting for teacher help, etc. 
Such passive responses are not conducive to effective 
lea r ni ng • 
Co n elusion 

When the data were examined among "active," "passive," 
and control students, it was found that the "passive" 
Student displayed the highest amount of active academic 
responding (71%) and the lowest amount of competing 
behavior (6%)» The " ac tive" s tuden t displayed somewhat 
less active academic responding (60%) than the "passive" 
student, but, as expected, displayed the highest amount of 
competing behavior (Ib'O- The control students had the 
lowest rates for active academic responding (58% and 52%) 
and the highest rates for passive responses (30% and 34%)# 

These observation data provide school personnel with a 
normative description of instruction. These data should be 
helpful in determining if Instruction, in general, looks as 
effective as desired. 
Per c eptual data 

This section is divided Into two subsections. The 
first subsection contains results related to students' 
perceptions, while tlie second one contains results related 
to teacliers' perceptions. 
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I* Students ' perceptions 

Table 7 displays tlie overall breakdown of the students* 
grade level. Note that a quarter of the students were in 
the 9th grade. For statistical purposes, grades 4 through 
8 were collapsed into one category (lower academic 
standing); grades 9 through 12 were collapsed into another 
category (upper academic standing). Also, for statistical 
purposes, two groups were formed based on the response to 
the question, "Have you learned a lot in this school?" One 
student did not answer, leaving a total of 69 valid cases. 
Ten students (15%) stated that they did not learn a lot, 
whereas 59 students (85%) answered affirmatively. The 
following are verbatim responses as reasons for checking 
negatively (numbers in parentheses are numbers of 
respondents answering alike): 

- "The way we are held back." (4) 

- "1 have not been here for very long*" (2) 

- No comraen t • ( 2 ) 

- "The teachers do not listen to the students." (1) 

- "We cannot choose classes, and there is a lack of variety 
of classes, such as foreign languages and wrestling." (1) 

In response to the question, "What grade would you give 
this school?" (ratings ranged from I to 5, with 5 being the 
most positive), the mean answer was 3.29, indicating that 
the students perceived Ozanam to be average. The following 
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are verbatim responses as reasons £or checking poor (n~5) 
or below average (n=8) (numbers in parentheses are numbers 
of respondents answering alike): 

- "The teachers don't listen to the kids." (2) 

- "Too much R/R is given out by the teachers for incomplete 
as signments • ** (2) 

- "Lack of variety of classes^" (1) 

- "1 am in the 12Lh grade, and I do now what I did in the 
5th grade." (1) 

- "Because some people cannot benefit any longer from this 
school and need to move on." (1) 

- "It doesn't teach anything 1 have not learned already. 
Plus, just because I am 12 [years old), I can't be in 
algebra even though I test high enough." (1) 

- "1 don't need to be in this school." (1) 

- "I jusL don't like this school." (1) 

- "Sometimes the school teachers don't teach one regular 
program." (1) 

- "Because I have been doing the same school work." (1) 

- "Too much B. S. . " ( 1 ) 

This question was also statistically significant when 
"learn a lot" was the independent variable, T(67)-3.55, 
£<.001. This means that those who marked that they learned 
a lot in school were significantly different from those who 
marked that they did not learn a lot in school. The former 
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rated Ozanam more positively (M=3«48) than the latter 
(M==2.30)« Based on tihis highly statistically significant; 
finding and the written responses as reasons for checking 
poor or below average, it can be inferred that one of the 
reasons to rate Ozanam unfavorably may be linked to one's 
perception of lack of academic progress.. 

The responses to the forced-choice items in question 3 
are summarized in Table 8. These items measured student 
perceptions of the degree to which effective school 
practices were in place. 

Responses to item 3A show that over half the students 
(38«6%) agree that their teachers are well prepared for 
class and start and end class promptly. Similar results 
are found In item 3B, in which over half of the students 
(52^2%) agree that their teachers start on time and 
continue teaching to the final bell. Such results indicate 
that the students thought their teachers were punctual and 
responsible adults. 

Question 3C is inter f> sting because many students had 
different points of view. Almost half of the students 
(44.9%) agreed with the statement regarding the typical 
dally lessons sequence; almost one-third (30^4%) were 
undecided; r\n6 about one-fourth (24.6%) disagreed with the 
state went 4 l-^oreover, this item was statistically 
significant when academic standing was the independent 



TABLE 8 



Student Questionnaire Responses 



It era 



Re s pen se 
Alte rnativefe 



Recponses 



3A. Teachers are well. !• 

prepared for class 2 • 

and start and end 3. 

class p romp t ly • ^ • 

5. 

3B. Teachers start on !• 

tirae and continue 2. 

teaching to the final 3. 

bell. ^• 

5. 

3C. Typical daily lessons !• 

follow this sequence: 2. 

teacher presentation, 3« 

student practice, A. 

specific feedback, 5. 
evaluation of student 
per f ormance • 

3D. There are few student !• 
interruptions during 2. 
classtime* 3« 

A • 

5. 

3E. Most studentT/ take !• 
part in c^iLSsroom 2. 
discussions • 3 • 

A . 
5. 

3F. Outside interruptions !• 
do not often interfere 2* 
with instruction. 3. 

A . 
5. 



Strongly 


agree 


13.6% 


(13) 


Ag r e e 




AO .0% 


( 28 ) 


Undecided 




22.9% 


( 16 ) 


Di sag re e 




12.9% 


(9 ) 


Strongly 


disagree 


5.7% 


(A) 


MEAN 




2.A7 




Strongly 


agree 


2 3.2% 


(16) 


Ag r e e 




29.0% 


(20) 


Undecided 




lb, 17. 


(18) 


Disagree 




i 1 . 6 % 


(8) 


Strongly 


disagree 


10.1% 


(7) 


MEAN 




2. 57 




Strongly 


agree 


21.7% 


(15) 


Ag r e e 




2 3.2% 


(16) 


Undec id ed 


30 .A% 


(21) 


Disagree 




17 .A% 


(12) 


Strongly 


disagree 


7 . 2% 


(5) 


MEAN 




2.65 





Strongly agree 


1 1 . A% 


(8) 


Ag re e 


17.1% 


(12) 


Undecided 


15.7% 


(11) 


Disagree 


17.1% 


(12) 


Strongly disagree* 


38 .6% 


(27) 


MEAN 


3. 5A 




Strongly agree 


2 2.9% 


(16) 


Ag re e 


3 2.9% 


(23) 


Undecided 


2 5.7% 


(18) 


Disagree 


8.6% 


(6) 


Strongly disagree 


10.0% 


(7) 


MEAN 


2. 50 




Strongly agree 


U . 5% 


(10) 


Ag re e 


26 . 1% 


(13) 


Undecided 


20 . 3% 


(H) 


Disagree 


21.7% 


(15) 


Strongly disagree 


17.4% 


(12) 


MEAN 


3.01 





45 



Continuation of Table 8 
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Note: Figures in parentheses are numbers of respondents 
choosing each alternatives. 



ERIC 



A 6 

variable, T( 6 5 )= 2 .08., £<.0A. This means that those of 
lower academic standing (M=2.56) agreed more with the 
statement that those of upper academic standing (M=2.88). 

In response to item 3D, over half the students (55»7%) 
Indicated that they dlsagee with the statement that there 
ate few student interruptions during class time* 

Responses to item 3E show that over half the students 
(55.8%) indicated that they partake in classroom 
discussion* This is indicative of student involvement and 
of "active'' academic responding (refer to eco-behavioral 
approach) which signify effective loarning. This item was 
also statistically significant when academic standing was 
the independent variable, T[(63)=2.13, £<»0^» This means 
that students of lower academic standing (M=2«18) agreed 
more with the statement that upper academic standing 
students (M=2.75). 

In response to item 3F, a sizable number of students 
(AO. 6%) agreed with the statement that outside 
Interruptions did not often interfere with instruction, 
whereas 39*1% of the students disagreed with the statement. 
Moreover, the findings found in item 3D indicated that over 
half the students (55.7%) disagreed that there were few 
student interruptions during class time* Taken all 
together, the data show no^ clear indication whether 
interruptions constitute a problem or not. There is the 

I k) 
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suggestion of a ne,^ar,ive effect to instruction due to many 
classroom interruptions* 

In response to Item 3G , over half tlie students (53»8%) 
agreed that their teachers planned assignments so that 
students would be highly successful during practice work, 
following direct instruction. This is indicative that 
effective instruction is at work. 

The responses to the forced--choice items in question 4 
are summarized in Table 9. These items measured student 
perceptions of the degree to which they felt they were 
helped academically. For statistical purposes, the 
category "do not know" was deleted from lurther 
computations because oE insufficient cases. 

Responses to item 4A show that almost 60% of the 
students agreed they were treated uith fairness. This is 
indicative of a positive atmosphere ^nd rapport between 
teacher atid student. 

Responses to item 4B show that over half the students 
(53.6%) enjoyed going to class. This item was 
statistically significant when "learn a lot" was the 
independent variable, chi-square (1, N^"^ ^8 )«8 . 1 5 , £<.004 . 
This means that the majority of those who stated that they 
had learned a lot In school overwhelmingly enjoyed going to 
classt Conversely, those who stated that thtiy did not 
learn a lot tended not to enjoy going to class. Note that 
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Table 9 



Student: Questionnaire Responses 
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Note : Figures in parentheses are numbers of respondents 
choosi ng ' each alternative. 
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this statement should be taken cautiously because of the 
small number of cases In this category. 

Of particular Interest Is Item A €• The majority of the 
students (88.6%) stated that they received help from their 
teachers. This is a very good indication that the program 
is having a positive impact on the students. 

Responses to item AD show that about half the students 
(5C.7%) stated that they felt better about school since 
they had been at Ozanara. This item was statistically 
significant when academic standing was the independent 
variable, chi-square (1, N-58)=4.79, £<.03. This means 
that those of lower academic standing tended to feel better 
about school, whereas those of upper academic standing had 
mixed responses; although there was a tendency for the 
latter to disagree with the statement, especially when 
compared to the lower academic standing students. 

In response to item AE, half the students stated that 
they had improved their reading skills while at Ozanam. 
This item was statistically significant when "learn a lot" 
was the independent variable, chi--square (1, N= 56) = 7.62, 
£<.0O6. This means that those who stated that they had 
learned a lot in school overwhelmingly marked that their 
reading skills had improved. Conversely, those who stated 
that they did not learn a lot tended to mark that tiielr 
reading skills did not improve. Note that this last 
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statement should be taken cautiously because of the small 
number of cases in this category. 

Responses to item show that a great number of 
students (71%) agree that their math skills have improved. 
This means that the program seems to have a positive 
effect. This item was statistically significant when "learn 
a lot" was the independent variable, chi-square 
(1, |J = 64) = 4.12, £<.04. This means that those students who 
indicated that they learned a lot in school overwhelmingly 
marked that their math skills had improved, whereas those 
who did not indicate so showed mixed results; although 
there was a tendency for the latter to disagree with the 
statement. Again, caut<on is advised with this last 
statement because of the small number of cases in this 
category. In response to item 4G, almost 60% of the 
students reported chat they Improved their writing skills. 
Again, this is Indicative that the program seems to have a 
positive impact on students. 

Responses to item show that 66.7% of the students 
disagree with the statement that the school at Or -jam has 
not^ helped them improve their reading, math, and writing 
skills. The above finding is in keeping with the other 
findings in which a great number of students stated that 
they have been helped th their reading, math, and writing 
skills while at Ozanam. Item 4H was statistically 
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significant when ^'iearn a lot'* was the independent 
variable, chl-square (1, N-60)=13.52, £<.0002* This means 
that the majority of the students who stated that they 
learned a lot in school overwhelmingly marked that they 
disagree with the statement, indicating that they did learn 
essential academic skills while at Ozanam^ Conversely, 
those who indicated that they did not learn a lot in school 
tende d to agree with the statement. Note that caution is 
advised with this last statement because of the small 
number of cases in this category* 

The responses to the f o r c e d - c ho i c e items in question 5 
indicate student perceptions of the reasons why they attend 
school at Ozanam* It is worth noting that nine students 
left all items in this question blank and commented that it 
was "none of your business*' or "it is private.** It can be 
inferred that this question probed a sensitive area for 
these boys* 

The responses of the 61 studet)ts who answered this 

« 

question follow below. Note that the figures in 
parentheses represent the numbers of students checking each 
item. 
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Pe rcentages 

- My behavior at my other school was poor 61% (37) 

- I did not follow orders. A6% (28) 
-Igotmanybadgrades. 44%(27) 
-Isklppodalotofclasses. 26%(16) 

- I do not knowwhy I was selected* 26% (16) 
The above percentages were calculated based on the number 
of responses for each item. Percentages exceed 100% 
because each respondent could check more than one item. 

Of particular interest is that slightly over 
one-quarter of the respondents checked that they did not 
know why they were selected to attend school at Ozanam's 
special education program. This may need to be rectified 
by clearer communication between caregiver and student. 

The responses to the forced-choice items in question 6 
indicate student perceptions of how they perceive 
themselves now . This question is particularly useful in 
determining if the students perceive improvement, thus 
indicating how successful in the program has been in 
meeting its goal. The responses to question 6 follow 
be 1 ow . 
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Pe 'centage 

- I have improved my behavior at schools 71% (A9) 

- I have studied harder and have improved 64% (44) 
my grades* 

1 have improved my school attendance* 44% (30) 

- My school attendance, grades, and behavior 9% (6) 
are about the same* 

- My school attendance, grades, and behavior 3% (2) 
are worse than before. 

Note that the fi.gures in parentheses represent the numbers 
of students checking each item. Percentages were 
calculated based on the number of responses for each item* 
Percentages exceed 100% because each student could check 
more than one item* 

It is evident from the findings above that an 
overwhelming majority of students felt they had improved a 
good deal in behavior, study habits and grades, and 
attendance* This is good evidence that the program has 
been saccessful with these students* 

Comments provided by students in response to the 
open-ended questions, '*What are some good things about this 
school?*' and **How could this school be improved?'' are 
summarised below* Although a variety of comments were made 
in response to both questions, the following items were 
deemed to have some consensus due to the frequency with 
which they were mentioned* 
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- Teachers (attitude & effort) 


34 


(53%) 


- Classes (small, Interesting and not too 


26 


(41%) 


difficult) 






- Sports 


6 


(9% ) 


- Atmosphere 


5 


(8%) 


Areas needing improvement 


Resp 


onses 


- Better food 


8 


(15%) 


- Less R/R 


7 


(13%) 


- More free t i me 


7 


(13%) 



II Teachers' perceptions 

Seventy-five curricular objectives were stated by the 
teachers, of which 53 (71%) of them were accomplished by 
the end of the semester. Seventeen (23%) curricular 
objectives were not accomplished by the end of the semester 
and 5 (6%) curricular objectives were ''ongoings" This is a 
good indication that most curricular objectives were 
covered by the end of the semester. It is suggested that a 
few objectives be more clearly defined. For instance, 
"ongoing objectives'* rtin the risk of never being reached 
because it can never be known when they have been 
accomplished. 

All teachers indicated that they were able to get ail 
the materials they needed. This is a good indication that 
the school is well supplied. 
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In all but one case, teachers reported that their 
students eajoyed instruction. In the words of that one 
teacher, students enjoy Instruction "only when [the] skills 
required are skills the student[s] already possess." 
Enjoyment of instruction appears to be acknowledged by most 
teachers and students, indicating congruent viewpoints. 

Teachers consistently reported that their students 
write and read ajt l east one to two times per week. All in 
all, it is suggested that this area may need improvement. 
Some courses do require more reading and writing than 
others; however, these skills are so essential that they 
need to be emphasized as much as possible (not applicable 
areas, such as physical education, were naturally excluded 
from computations). 

All teachers agreed that they feel satisfied with the 
facilities in which they teach. Classroom observers 
consistently found clean classrooms with hard working 
teachers serving attentive students. 

All teachers agreed that they enjoy participating in 
the program. This indicates an extremely favorable opinion 
of the program. 

All teachers agreed that they have good support from 
the administration. This indicates good rapport between 
teachers and administrators. They also agreed that the 
program offers a quality education with equity for all 
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students. Almost 60% of the student population agreed with 
the last statement, thus supporting the notion of fairness* 

The majority of the teachers (n^ll) disagreed that 
there are few student interruptions. They also disagreed 
(n=ll) that factors outside the classroom rarely interrupt 
basic, skills instruction. This is somewhat congruent with 
the students' perception, indicating that classroom 
interruptions may be a problem that needs to be further 
investigated in order to determine when the interruptions 
are mostly made, their reasons, and what might be done 
about it. 

In all but one case, teachers reported that special 
instructional aids for individual students are Integra r.ed 
with classroom instruction and school curric<«lum. This is 
indicative of individualized instruction. 

The majority of the teachers (n=13) reported that daily 
lessons follow this sequence: teacher presentation, student 
practice, specific feedback, evaluation of student 
performance. This is somewhat congruent with the students* 
perception, indicating that the above format may happen 
most of the time. 

All teachers agreed that they expect and plan 
assignments so that students will be highly successful 
during practice work following direct instruction.. This is 
congruent with the students ' perception, indicating that 

h 7) 
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such procedure may happen most of the time* 

The majority of the teachers (n=i3) agreed that class 
atmosphere is generally very conducive to learning for all 
students^ Classroom observers also noted a positive 
atmosphere present in the classrooms* 

The majority of the teachers (n=13) agreed that during 
basic instruction, students are no t working adependently 
on seatwork for the majority of the allocated time* This 
may be related to the classroom interruptions and the 
removal of students from the classroom. From the classroom 
observations, we gather evidence chat there is little or no 
small gi-'oup arrangement; consequently, we may deduce that 
the students may not be working independently on seatwork 
because of classroom rearrangements* It is also possible 
that some of the teachers did not understand the question* 

All teachers agreed that they start classes on time and 
continue teaching to the final bell* Most of the students 
reported similar perceptions, indicating no discrepancies* 

Comments provided by teachers In response to the 
open-tended questions, "What have been the strongest 
elements of the program?" and "In what ways should the 
program be improved? are summarized below* Because of a 
clerical mistake, the teacher questionnaire was initially 
administered without the last page, which contained the 
open--t*nded questions* After the mistake was rectified. 
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only 10 of the 15 respondents completed the last page. The 
comments from five teachers are missing* 

Strengths Numbe r of re sponse 

Staff support 7 
Broad'-basedcurriculum 2 
Flexible scheduling 2 
Total milieu approach 2 
Having students as residents 1 
Experimentation is encouraged 1 
Personal involvement 1 
Discipline ^ 
Comments do not add up to 10 because respondents could make 
more than one conment. 

Areas needing Improvement Number of responses 

Better communication amongst 6 
departmental staff 

Moreatdes ^ 
Increase planning time 2 

Classroom observers noted some form of a token economy 
system present in the classrooms* In order to tap the 
teachers* perception toward such a system, the following 
question was added, '*In your opinion, how successful is the 
school token economy system?** The answers to this quescion 
revealed a complicated network of token economy systems 
that lacks consistency* Some verbatim comments may 
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exemplify: "Each teacher is allowed to design and use [his 
or] her own token system"; "It varies greatly"; "We have no 
'all school' system. My clas."* has its own point system"; 
"If the school has a token economy system, it is new to 
me"; and "Each teacher uses [his or her] own form of points 
and point sheets." 

It seems that the school has a hodgepodge of token 
economy systems* Fol the teachers who use some form of 
token economy system> e.g., point system, privilege system, 
etc., they find it very useful* Freedom and creativity are 
very desirable traits; however, it is sugggested that some 
consistency should exist '^s well in order to reinforce 
positive student behaviors. 
Conclusion 

The questionnaire data on the perceptions of teachers 
and students regarding the program were very positive. 
Teachers consistently reported their satisfaction with the 
program. Students overwhelmingly reported that they were 
helped academically. Classroom observers reported that the 
classes they observed ran smootlily and efficiently. 

Conceins raised by students include better food. 
Teachers raised the issue of better coramunication amongst 
different departraeutal staff. In addition, classroom 
interruptions and the different reinforcement strategies 
may be areas of concern that warrant further investigation. 
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Achievement Data 

In order to examine longitudinal trends in the PIAT and 
WISC-'R scores, the data will be examined year-by-year. 

1985 

During January through December, 1985, 19 boys were 
discharged from Ozanam's special education program* Eight 
of these boys showed evidence of learning disability; no 
data were available for the remaining boys* All eight boys 
showing learning disability received special education 
classes prior to coming to Ozanam, seven boys had not, and 
the remaining seven boys had no data# It is interesting to 
note that none of the 19 boys discharged in 1985 hadf^i 
attending off-grounds school either full time or part time* 

Table 10 shows the mean scores for the WISC-R verbal, 
performance, and full scales* It appears that there is a 
slight increase in the mean scores for all three scales* 
Caution is advised in interpreting this slight gain because 
six boys were not administered the WISC-R at the time of 
admission and 13 boys did not have the WISC-R taken at the 
time of discharge* The number of months between initial 
I*Q* testing and final I.Q* testing ranged from 13 to 31 
months ( M= 22*2)* 

The relationship between initial and final PIAT results 
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Table lU 

1985 Mean Scores for WISC-R Vorbal. , Performance, & Full Scale 



A d m i. s s 1 o n Dlschargo 
Verbal 9 7 99 
Performance 105 108 
Full 100 103 



Total Cases 13 6 
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(n«5) considering chronological growth is summarized below* 
MATH. Two boys decreased their scores less than or 
equal to one year. Three boys increased their scores 
gi.* eater than one year. 

SPELLING, Two boys decreased their scores greater than 
one year. One boy increased his scores less than or 
equal to one year. Two boys increased their scores 
greater than one year. 

READING RECOGNITION. One boy decreased his scores less 
than or equal to one year. Four boys increased their 
scores greater than one year. 

READING COMPREHENSION. One boy decreased his scores 
less than or equal to one year. One boy had no change. 
Three boys increased their scores greater than one 
year. 

GENERAL INFORMATION. One boy decreased his scores 
greater than one year. One boy had no change. One boy 
increased his scores less than or equal to one year. 
Two boys increased their scores greater than one year. 
TOTAL. One boy increased his scores less than or equal 
to one year. Four boys increased their scores greater 
than one year. 

The relationship becweeu initial and final FIAT toLal 
results considering chronological growth seems encouraging 
because all five available cases increased their total 
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performance- Caution is advised iw interpreting this 
seemingly optimistic trend of the total results because 
some boys decreased or showed no chanye in some areas. 
Moreover, there are 14 cases with no data. The number of 
months between initial PIAT testing and final PIAT testing 
ranged from 11 to 29 months (M=^16.6). 
1986 

During January through December, 1986, 21 boys were 
discharged from Ozanam*s special education program. Ten of 
these boys showed evidence of learning disability; no data 
were available for the remaining 11 boys. All boys showing 
learning disability received special treatment while st 
Ozanara^ Three boys had received special education classes 
prior to coming to Ozanam, one boy had not, and the 
remaining 17 boys had no data. It is interesting to note 
that the majority (n=19) of the boys discharged in 1986 had 
not attend off-grounds school either full time or part 
time; two boys did go off-grounds both part time and full 
timo. • 

Tdble li shows the mean scores for the WISC-R verbal, 
performance, and full scales. The pre-'test mean scores and 
the post-test mean scores are almost identical for all 
three scales (slightly lower for the discharge verbal and 
full scales), indicating no gains from p re-test to 
post-test. The number of months between initial l.Q. 
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Table 11 

1986 Mean Scores for WISC-R Verbal, Performance, & Full Scale 



Admissi.on Discharge 
Verbal 96 92 
Performance 100 100 
Full 96 95 



Total Cases 17 13 
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testing and final ItQ* testing shows outliers, that is, 
extreme scores ranging from 0 to 96 months ( med i an^ 26 ) • 
Such discrepancies in the number of months between Initial 
I*Q# testing and final ItQt testing may have contributed 
for no gains from pre*-test to post^testt 

The relationship between initial and final PIAT results 
(n*^lA) considering chronological growth is summarized 
be I0W4 

MATHt Six boys decreased their scores greater than one 
year. Two boys decreased their scores less than or 
equal to one year* Two boys had no change* Four boys 
increased their scores greater than one year* 
SPELLING* Seven boys decreased their scores greater 
than one! year* Two boys decreased their scores less 
than or equal to one year* One boy had no change* 
Four boys increased their scores greater than one year* 
READING RECOGNITION* Three boys decreased their scores 
greater than one year* Two boys decreased their scores 
less than or equal to one year* Nine boys increased 
their scores greater than one year* 

READING COMPREHENSION* Four boys decreased their 
scores greater than one year* One boy decreased his 
scores less than or equal to on»^ year* One hoy had no 
change* Two boys increased their scores less than or 
equal to one year* Six boys increased their scores 
greater than one year* 
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GENERAL INFORMATION^ Thrse boys decreased their scores 
greater than one year. Three boys decreased their 
scores less than or equal to one year. One boy 
increased hi Is scores less than or equal to one year- 
Seven boys increased their scores greater than one 
year* 

TOTAL. Two boys decreased nheir scores greater than 
one year. Seven boys decreased r. heir scores less than 
or equal to one year. One boy had no change. Four 
boys Increased their scores greater chan one year. 
The relationship between initial and final PIAT results 
considering chronological growth showed mixed results. 
While the majority of the boys showed an increase in their 
scores for reading recognition (n^9), reading comprehension 
(n=^8), and general information (n^'S), there was a decrease 
for the irajority of the boys in math (n = 8), spelling (n-9), 
and total score (n~9)* The number oE months between 
initial PIAT testing and final PIAT testing shows outliers, 
that is, extreme scores ranging from 0 to months 
( Medi an== 1 7 . 5 ) . Such discrepancies in the number of months 
between initial PIAT testing and final PIAT testing may 
have contributed to the mixed results found. 

During January through Deccnber, ^87, 33 boys were 
discharged from a nam's special education program. Two of 
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those boys showed evidence of learning disability; no data 
were available for the remaining 31 boys. One of the boys 
showing learning disability received special treatment 
while at Ozanam; no data were available for the other boy. 
Two boys had received special education classes prior to 
coming to Ozanam; the remaining 31 cases had no available 
data. It is interesting to note that the majority of the 
boys (n=26) discharged in 1987 had not attended school 
either full time or part time; two boys did go to 
off-grounds school full time, while two others went both 
part time and full time; no data were abailable for the 
remaining three boys. 

Table 12 shows the mean scores for the WISC-R verbal, 
performance, and full scales. It appears that there is a 
modest increase in the mean scores for all three scales. 
Caution is advised in interpreting this slight gain because 
19 boys did not have the WISC-R taken at the time of 
discharge. The number of months between initial I.Q. 
testing and final I.Q. testing ranged from 15 to 56 months 
(M='28.4). 

The relationship between the initial and final PIAT 
results (n=23) considering chronological growth is 
summarized below. 

MATH. Five boys decreased their scores greater than 
one year. Two boys decreased their scores less than or 
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Table 12 

1987 Mean Scores for WISC-R Verbal, Performance, & Full Scale 



Admission Discharge 
Verbal 93 97 
Performan ce 104 105 
Full 98 100 



Total Cases 31 14 
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equal to one year* One boy had no changet Three boys 
increased their scores les?? than or equal to one year* 
Twelve boys increased their scores greater than one 
y e a r • 

SPELLING* Three boys decreased their scores greater 
than one year. Five boys decreased their scores less 
than or equal Co one year* One boy had no change* 
Four boys increased their scores less than or equal to 
one year* Ten boys increased their scores greater than 
one year* 

READING RECOGNITION. Five boys decreased their scores 
^^reater than one year. Three boys decreased their 
scores less than or equal to one year. One boy had no 
change. One boy increased his scores less than or 
equal to one year. Thirteen boys increased their 
scot^s greater than une year. 

READING COMPREHENSION. Two boys aecreased their scores 
greater than one year. Four boys decreased their 
scores less than or equal to one year. One boy had no 
change. Two boys increased their scores less than or 
equal to one year. Fourteen boys increased their 
scores greater than one year. 

GENERAL INFORMATION. One boy decrea^'.ed his scores 
greater than one year. One boy decreased his scores 
less than or equal to one year. Two boys had no cliange. 
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Three boys increased their scores less than or equal to 
one year. Sixteen boys increased their scores greater 
than one yaar. 

TOTAL* One boy decreased his scores greater than one 
year* Two boys decreased their scores less than or 
equal to one year* Seven boys increased their scores 
less than or equal to one year. Thirteen boys 
increased their scores greater than one year. 
The relationship between initial and final PIAT scores 
appears very encouraging* Most children increased their 
scores from pre-test to post-test in all areas* However, a 
few children decreased or showed no change in some areas* 
The number of months between initial PIAT testing and final 
PIAT testing ranged from 11 to 60 months (M-20.3). 
Conclusion 

All in all, the achievement data presented thus far 
show an optimistic trend, but *'he data remain weak* There 
were few available cases for 1985, preventing 
generalizations. There was an extreme range of number of 
months between initial testing and final testing for 1986, 
clouding the results* Actually, the only valid data appear 
to be for 1 987, which show e ncou r ajr; i ng resulti:^. 

Last but not least, t ^ PIAT and WISC-R might not be 
adequate tests to be used to measure student nro'^ress. The 
weak findings obtained might be related to the 



71 



inappropriate use oC these tests. The PIAT and WISC-R may 
be valid tools for student placement, but they seem to be 
poor evaluating measures of student learnings 
Follow-up Data 

Informants' responses to the telephone interviews 
revealed the following findings^ In response to the 
question, ''Kow many jobs has the former student held since 
discharge?'', the mean answer was 2 • 20 , indicating a 
somewhat steady placements 

In response to the question, ''What education has the 
former student received since discharge?'', the most 
frequent response (1. 1 out of 19) was high school gradua'ie 
(or very soon likely), indicating that most of these 
students did not go beyond the secondary levels making the 
education they did receive very essential for them^ In 
response to the question, "How wouid you rate the former 
student's occupational functioning since discharge?" 
(ratings ranged from 1 to 9, with 9 being the most 
positive), the mean answer was 5*36, indicating that the 
informants rated the former students to be functioning at 
an average level, although slightly better than their 
occupational functioning. 

Note that the follow-up findin)^s should be taken 
cautiously because this researcher wa^; unable to reach a 
sizable number of parents/informants. 
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Conclusion 

Because of the small sample size, generalizations from 
the findings cannot be made^ The data obtained illustrate, 
however, that for these former students, their occupational 
and educational functioning appear to be at an average 
level. 

CONCLUSIONS 

This evaluation was divided into sections because it is 
good heuristics to break down a complex phenomenon, such as 
the evaluation of Ozanam's special education program, into 
mroe manageable parts« However, these various parts are 
not Isolated, but, instead, they are "gestalten," that is, 
they are interrelated, with the sum of their parts 
conveying a more complete picture. The aim of this final 
section is to address the "larger picture" and to provide 
recommendations or suggestions. 

The original goal of the program is to strengthen a 
boy's academic and social weaknesses while encouraging his 
academic interest, thus preventing possible future 
placement in an institution. Such a goal may also be 
broken down into parts. The first subgoal addresses a 
boy's academic development* This may be the easiest part 
of the program to assess, measure, and validate. The 
eco-behavioral approach, parts of the teacher and i;tudent 
questionnaires, and achievement data provided evidence that 



73 



Ozanam may be achieving this part of the lar^.er goal. 

Greenwood, Delquari, Stanley, Terry, and Hall (1985) 
stated that research using an eco-"be havio ral interaction 
approach in the classroom offers the potential of studying 
students' academic achievement or failure in terms of their 
actual performance in relation to opportunities to learn» 
It shows how instruction affects student behavior from 
moment to mo meat. Such an a;proach helps OEanam know 
firsthand whether instruction in the classroom is promotion 
student success or failure. The data obtained did indicate 
that 60% of the observed classroom instructions was devoted 
to active academic responding, which is a good indicator of 
student academic success* 

Perceptioiis of students and teachers regarding 
instruction provided evidence of: (1) a match of 
perceptions between teachers and students, (2) student 
academic progress, and (3) general satisfaction with the 
program. Achievement data provided tividence of some 
academic progress for some students* 

All in all, the program seems to be effective in the 
academic realm. Certain areas of the program, though, need 
some attention if Ozanam is to complete the full cycle 
toward rehabilitating these youngsters. 

The second subgoal addresses a boy's social and 
emotional adjustment* Parts of the student and teacher 
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questionnaire addressed this section of the larger goal* 
Teachers and students reported progress in the students' 
social and emotional adjustment* A note of caution: social 
and emotional outcomes are not simple measures that an 
evaluator can assess, measure, and validate. There are 
strong subjective elements involved--the creation of ideal 
ways of behaving on the minds of adults and teenagers, 
irrational fears or expectations, distrust, and so forth--that 
may obscure the realities of objective judgment on the part 
of the respondents* 

The last subgoal addresses prevention, which may be the 
ultimate measure of success in rehabilitating these 
youngsters* The follow- up addressed the issue of 
prevention by checking on the current occupational and 
educational levels of former residents* The few former 
residents who were contacted appeared to be functioning at 
an average level* No conclusions can be drawn at this 
point because of insufficient cases contacted* Brevontlon 
is an area to be investigated further* 

The overall impression one gathers from the data 
presented thus far is that of a successful program* 
Program implementation indicators seem to show a positive 
impact on students* Teachers reported positive working 
relationships and satisfactory working conditions* 
Students reported orogress in their academic, social, and 
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emotional skills. Achievement scores appear to show a 
positive trend, which is apparently weak. For the most 
part, the special education program at Ozanam appears to be 
running fairly well, offering a quality education with 
equity for all students. There are areas of concern, 
though, that need some special attention. The following 
recommendations, or suggestions, are offered in this vein* 

1. It is strongly urged that those in charge reconsider 
how the PI AT and WISC-R are used in assessing school 
achievement. These tests may have great validity 
clinically, but they are poor measures of school 
achievement. The PIAT and WISC-R are standardized 
norm- referenced tests brsed on a wide range of 
objectives. They are not adequate nor sensitive 
enough to measure changes in achievement. Criterion 
referenced tests closely tied to academic objectives 
and matched to the levels at which students receive 
instruction would provide more accurate evaluation 
measures of student learning. In sum, it is 
recommended that c u r r i c vi 1 um-ba se d assessment 
procedures be developed for documenting student 
(progress • 

2. It might be helpful for the teachers to concentrate on 
a mo re clearly defined set of objectives. 

3. It might be helpful to have an all-school token economy 
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system. At present, the school has a hodgepodge of 
token economy systems, lacking consistency in 
reinforcing desirable student behaviors and 
extinguishing undesirable ones. , , 

4. It is recommended that the origins of classroom 
interruptions be investigated, when they art: mostly 
made, and their reasons, so that instruction will not 
be as frequently interrupted in the future as it 
appears to be now. 

5. It ii? recommended that follow-ups of discharged 
students be conducted every six months with a family 
member. In addition to more frequent follow-ups, it 
is recommended that a more ad'-quate questionnaire be 
constructed in order to have more adequate evaluation 
measures of prevention. 

6. Looking ahead to the future, it is recommended that a 
evaluation similar to this one be conducted by the en 
of the spring semester of 1989, to assess whether 
improvements have been made regarding these areas of 
concern . 
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OBSERVATION CODE DEFINITIONS 
STUDENT BEHAVIOR CATEGORY - ACTIVE RESPONSE 

W; Wrice 

is recorded when the student is observed marking tasks 
with a pencil, pen, crayon, or other writiny tool. This 
involves holding the instrument between the thumb and 
forefinger and moving it in a manner likely to produce 
letters y numbers, drawings, or words. 
T P : Task Partic i pa t i o n 

•'TP'' is recorded when the student is observed using or 
participating in an academic activity, either individually or 
with peers* The response may be verbal, mrtor, or social* 
The student may be manipulating flash cards, coloring, using 
ncissors^ playing with an academic toy or game, spinnii>^ a 
wheel, moving a pawn on a board, etc. 
RA ; Read Aloud 

^'RA^' is recorded when the student is looking at printed 
material and speaking aloud what is written. This may be 
words or numbers. 
TA; T alk Acad emi c 

*'TA'' is recorded when the student is verbalizing about the 
activity i.e., the subject matter* Spelling words aloud, 
presentl'g words to'be spelled by a peer, and correcting a 
peer are examples. 



R S ; Read Silent 

"RS" is recorded when the student is looking directly at 
printed materials and eye movements suggest that the student 
is scanning the material* Materials may be books, flash 
cards, words on the chalkboard, etc. Students may he reading 
words or numbers. 

STUDENT BEHAVIOR CATEGORY - PASSIVE RESPONSE 
AT: Attention to Ta sk 

*'AT'' is recorded in the absence of the above active 
responses and consists of looking at the teacher or at 
academically related material. 
OA: Other Appropriate 

''OA" IS recorded to indicate the occurrence of an 
appropriate student behavior not defined rbove, e.g., sitting 
at the desk quietly. 

STUDENT BEHAVIOR CATEGORY - INAPPROPRIATE ?EHAV10R 
LA: Looking Around 

"LA" is recorded when the student is looking at 
noninstructional or nonacademlcally rela ed material, or 
things such as other students, the room in general, a comic 
book , etc. 
D : Dis ruptive 

"D" is used to code student beliavlors that are (10) 
aggressive, such as hitting or pretending to hit, fighting, 
kicking, poking, slapping, hair^pulling, etc., and/or (2) 



no 



produce /ioud noises^ such as yelling, crying, banging, 
breaking, etc* Loud talk is coded "D". 
01: Other Ina pg^c opriate 

^'OI" is recorded to indicate the occurrence of an 
inappropriate student behavior not defined above, e.g., out of 
seat inappropriacely. 

TASK/MATERIAL CODES 

RR; Readers 

"RR'' is coded when the task is based on a reading primer 
or reading textbook, e.g., a basal reader, library book, or 
textbook . 
WB; Workbook 

''WB'' is coded when the task involves paperbacked, bound 
mater als that require both reading and writing by the 
student. These may be programmed reading workbooks or 
exercise books that accompany the main curriculum in reading, 
math, spelling^ or language. 
WS ; Worksheets 

Worksheets are usually teacher-prepared sheets on which 
the students are expected to read, then write their 
responses. Worksheets can be applied to any subject or 
activity. They are usually unbound, unlike a workbook^ and 
are generally done with light blue ink, having been copied 
on the school's ditto machine. *'WS'* is also coded wlien the 
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child Is working on the black b oard • (Excepclon: when the 
teacher uses the blctckboard, it becomes other media*) 
PP : Paper/Pencil 

"PP" is coded when the task involves paper and pencil 
materials^ including pens and other writing instruments* 
Paper may be lined or unlinedt 
LL: Listen to Lecture 

'*LL" represents the task of listening to teacher 
presentations, e.g#, chalkboard or overhead presentations, 
listening to a story being read by the teacher, etc., and is 
coded when the primary task is simply to look and listen to 
the teacher's instruction* 
OM; Other Media 

''OM'' is coded when a student is involved with a solitary 
task that is based on electronic media, e.g., overhead 
projector, tape recorder, film or computer, or other 
manipulative materials, e.g., abacus, counting rods, clocks, 
work cards, computers, newspapers, magazines, etc., and 
cannot be coded in another category. 
TSD : Teacher-^Student Discussion 

"TSD" is coded when a task involves listening to and 
talking with the teacher. For example, **LL*' may change o 
"TSD** when a teacher asks a question and it is answered by the 
student. "TSD*' is also coded when the teacher talks with a 
student individually. 




S^SDj^ Stud e nt - S c u d en t Disc us si on 

"SSO'' is coded when the task Involvo^s interaction with 
another student thst is not riK^diated by the teacher , e»g«, 
peer tutoring or independent small group projects* "SSD*' 
Is "TSD" with a peor instead of: a teacher* *'SSD" refers to 
academic interactions only as opposed Ls) inappr op r 4 a tr* 
talking* 

FP: Fetch/Put Away 

"FP^' is cou.:d when the student is (a) changing rarfks, 
or (b) stopping a current task and changing to a new one, 
c • s: . , the teacher says, "All right, students, ic^s time to 
clean up and go to recess/* or vhen student r are assembling 
into reading groups)* 
NMj No Mat erials 

**NM^' is coded when none of the tasks listed above are 
appropriate^ 

INSTRUCTIONAL ACTIVITY COOES 
The instructional activity is defined as the current type 
of learning experience being provided to a ma j o r i t y " of 
students by the classroom teacher* Generally, the activities 
are broad classifications of the kind of learning that Is 
occurring* For example, reading or math are major types of 
instructions* Such activities would generally be listed by 
the teacher if asked to describe his/her daily schedule* They 
would usually have an alloted time and agenda on days In which 



they occurs Instructional activities are not tasks , e • g • , 
write in workbooks, read alou in a reader, etc., but the 
general subject area or topic of Instruction is being 
provided. 

PL; Daily Living and Community Sk ills 

Dally living and community skills are those devoted to 
Independent living in the home and community, such as 
budgeting, laundry, cooking, and use of public transportation. 
R; Readln {< 

"R'' is coded (1) if the teacher Is presenting specific 
reading Instructions or the student is engaged in a reading 
activity. For example, if the teacher is heard instructing 
the students to "open your readers to page 103 or 105" or 
"let's read the story. to find out if Alice learned to make 
new friends," (2) If the majority of the children are 
engaged in some reading activity in classroom library, 
etc., or (3) when the student is receiving one-to-one or 
small group tutoring from teacher or aide, Reading 
activities Include the use of readers for oral and silent 
reading, vocabulary building, discussion of words, sounds, 
and types of sounds, such as vowels or consonants* Reading 
is often taught in small groups supervised by the teacher 
or an aide. 




M S; Motor Skills 

Motor skills are activities devoted to developing both 
fine and gross motor skills^ These activities are similar to 
physical education • 
Mj^ Math 

''M" is coded (1) when the teacher is heard instructing 
the children to begin mathematics work or activities; for 
example, "turn to where we left off yesterday and begin the 
problems/' (2) when the majority of children hav begun 
math work, or (3) when the student is receiving one-^to-one 
small group tutoring from the teacher or aide. Math may he 
coded when any activity involving the use of numbers, 
numeric concepts, geometry, time, weight, metrics, 
measurements, story problems, etc., is observed. 
Sj Spelling 

•*S'' is coded when the teacher is heard instructing the 
students in specific spelling activities. Instructions 
include: (1) ''Look at the spelling words on page 9 3,'* (2) 
when the majority of children are observed copying spelling 
work from the blackboard, finding a word in the dictionary, 
writing in a spelling workbook or notebook, or taking a 
spelling quiz or test, and (3) when the student is 
receiving one-to-one small group tutoring from the teacher 
or aide, are all coded as spellings 



H: Handwriting 

"H" is coded when the activity Is focusing on learning to 
write, e#g», print or cursive* It Involves the teacher 
showing the children how to hold a pencil or pen, and how to 
move their arm to make a letter or a word* The teacher may 
also discuss or demonstrate the size of the letters and the 
lines of the student^s writing papers between which the 
letters are to be written* Students will often be assigned to 
practice writing letters and words during handwriting or 
specially lined practice paper* For example, '^Today^s 
handwriting lesson will be on capital, cursive letters.'' "H" 
is also coded when the students are observed working in 
handwriting workbooks, practicing handwriting skills, e.g*, 
copying sentences or a paragraph from the blackboard and/or 
overhead, practicing during a chalkboard lesson with the 
teacher, or when the student is receiving onv2-on-one or small 
group tutoring. 
L : Langu age 

'•L'' Is coded when the activity is focusing on speech and 
language meaning* Code ''L'' when the ceacher instructs the 
students in language study; for example, "Please turn to 
ChapteL 4 in your language wtrkbooks*** **L*' is coded when the 
lesson Involves the meaning o£ words or meaning of physical 
relationships J, such as over, under, on top of, below, behi nd, 
etc* Also, creating prose, such as stories or poetry, are 



coded as language. Discussion of languages other than 
English, such as French, Russian, etc., creative writing ( in 
which how to spell or write letters is not checked as much as 
what the child wrote), book reports, listening exercises, 
etc., are also categorized as language. "L" is also coded 
when the student is receiving one-on-one or small group 
language tutoring from the teacher or aidec 
SC; Science 

"SC" is coded when the lesson is related to any science 
related topics (such as chemistry, electricity, space 
travel electronics, nature, insects, weather, mammals), and 
health related topics (such as body, exerices, and personal 
hygiene). Code "SC" when the children are using science 
tests, are watching laovies about science, are discussing a 
science topic from a Weekly Reader, watching an experiment 
in the class, or receiving one-on-one or small group 
science tutoring from the teacher or aide. 
PV; Prevocational/Vocationa-l 

Prevocational/vocational activities are those devoted to 

learning work and job skills. 

S C : S e 1 f -c a re 

Self-care activities are those devoted to personal 
hygiene, grooming, and other body care. Examples include: 
dressing, toileting, too t h b r u s hi ng , and bathing. 
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SS; Soci al Studies 

"SS" is coded when Che lesson is related to other 
cultures, ways of life in other nations and the United 
States, and jobs and roles in American society* Typically, 
the teacher will direct tho children to a specific page or 
assignment in a social science test, or other materials, 
such as maps, costumes, and pictures* However, he/she may 
also relate a story# For example, the following lessons 
would be coded as "SS": what firemen do, life on the farm, 
life in the city, American Indians, living on an island, 
going to school in England, families in America, labeling a 
map, completing a worksheet, and matching artifacts to 
South American countries* In addition, code "SS" when the 
lesson involves musical instruments, singing, and the use 
of media demonstrating musical scales, notes, or when the 
student is receiving one-on-one or small group "SS" 
tutoring from the teacher or aide* 
AC; Arts /Crafts 

"AC" is coded when the lesson involves drawing, painting, 
cutting with scissors, pasting, coloring, etc* The materials 
used in arts/crafts will be paints, colored chalk, art paper, 
scissors, paste, ?lue, etc. 
FT: Free t i me /S t u dy t i me 

"FT" is coded when the student begins an activity after 
the teacher has specified that free time is available* In 



free time/study time, children may select from several 
In-class activities. The activity is up to the student and 
may include puzzles, toys, or games* They also may work on 
any previously assigned academic task of their choice* 

t^RIMARY GROUP 

Structure is determined by the physical arrangement 
(teacher and students) and the instruction of activity 
assigned to the target student* The three structures to be 
coded are: Entire Group (EG), Small Group (SG), and Individua 
(!)♦ Structure is always coded for the student and not for 
the teac her • 
EG; Entire Group 

When the target student is within the same general 
seating arrangement and has the same assignment as all 
other students in the classroom, code "EG"» For example, 
students in close proximity at desks listening to teacher 
lecture, participating in t e ac h e r- s t ud e n t discussion, or at 
quiet study are examples of "EG"* 
SG: Small Group 

Code "SG" when the student being observed is seated or 
positioned next to at least one other student, both of whom 
are away from the other students in the classroom* Examples 
of "SG" are, small reading groups or discussion groups to rhe 
side oc rhe room, in the back of the room, at a table, or on 
carpet* The students can be working together, with an aide. 



or with the teacher* 

NOTE: Students left, e.g#, 2-5 siidepus, In the class- 
room after the other members have gone to math, lab, 
special class, etc*, and the target studenc Is one of 
the students who is also left, code ^'SG*' unless he/she 
is receiving special instruction# 
I: Individual 

Code when (1) the student you are observing is 

working on the ac ei vl ty /t ask as assigned to the entire 
class but is working alone with the teacher, (2) when the 
student is distinctly alone away from the other students 
(physically) or away from a small group and the assigned 
activity/task is different from the other students, e«g*, 
when in a study corraJl, special table, etc«, and (3) when 
the student is at his/her desk among the majority of 
students and the assigned ac tivi ty /task is different from 
the entire group. 

ALDITIONAL INFORMATION 

Clas s Size 

Record how many students are present in the classroom 
during each observation block* 

SELECTING THE TARGET STUDENT 

We don^t want the classroom teacher to treat the carge 
student any differently than if the child were not being 



observed. There forev when checking in, ask the teacher the 
names of three or four of the specific tjpes of students you 
are to observe* After the small pool of students is acquired, 
select the student you feel easiest to observe* Do not tell 
the teacher whom you have chosen to observe! 

Below is a defincion of a ''passive" and an "active'* 
student as described by the teacher: 
!• "Passive" student; 

A student whose school performance is impai -J by 
i nwa rd directed anger and well disguised hostility; 
usually manifested in behaviors to include deception, 
raanlpulation (lying), reserved overt response to 
directions, quiet resistiveness, flat affect, avoidance, 
low se 1 f --e s teem and an "I don't care" attitude, and 
general noncompliance which is meant to elicit 
emotional responses from others* 
2. "Active" student - a student whos^ school performance is 
impaired by ou twa rd directed anger and observable 
hostility, usually ma nif vested in behaviors to include 
argumentativeness, interruptions, liistractibility, 
fighting, inipuls i vi ty , high activity level, 
self-centered ness, destructive^ess, and excessive 
demands for teacher attention meant to satisfy the need 
for instant grt^rification. 
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STUDENT QUESTIONNAIRE 



The questions below are about your school. Please read each 
question caiefnlly and give your answer. Your answers are 
important because they will help us know how you feel about 
your school. YOU DO NOT NEED TO PUT YOUR NAME ON THIS PAPER 
Thank you for your help, 

What grade are you in? 



1. Have you learned a lot in this school? Yes No 

If "NO," why not? 



2. What grade would you give this school? (Please check only one) 

Poor 

Below average 

Average 

Good 

Excellent 

If you checked poor or below average, please explain. 



a . 



Please circle the number that indicates the extent to which 
you agrer ch the following statements. If you strongly agree 
with the - tement, circle "1." If you agree with the stateman 
circle "2.'' If you are undecided about the statement, ciicle 3 
If you disagree with the statement, circle "4." If you 
strongly disagree with the statement, c?rcle "5. 

Teachers are well prepared for class and ntart 1 2 3 A 5 
and end class promptly. 



b. Teachers start on time and continue teaching 1 2 3 A 5 
to t ii e final bell, 

c. Typical daily lessons follow this sequence: 1 2 3 A 5 
teacher presentation, student practice, 

specific feedback, evaluation of student 
performance . 

d. There are few student interruptions during 1 2 3 A 5 
class time. 



e. Mo3t students take part in classroom 
discussionf"! . 



1 2 3 A 5 



Outside interruptions do not often interfere 12 3 4 5 
with instruction. 

Teachers plan assignments so that students 12 3 4 5 

will be highly successful during practice 
work following direct instruction. 

Below is a list of the various experiences that may take place 

at this school. For each experience, check whether you agree, 

disagree, or do not know- 
Agree Disagree Don't Know 

I am treated with fairness. 

I enjoy going to class. 

I receive help from teachers, 

I feel better about school since 

I have been here* 

This school has helped me improve ^ 

my reading skills. 

This school has helped ;ne improve 

my math skills. 

This school has helped me improve 

my writing skills. 

This school has not helped me improve ^ 

my reading, math, and writing skills. 

Why were you selected to attend school at Ozanam? 

My behavior at my other school was poor. 

I got many bad grades. 

I did not follow orders. 

Iskippedalotofc lasses. 

I do not know why I was selected. 
Which of the following statements describes you now? 

I have improved my behavior at school. 
_1 have studied harder and have improved my grades- 
_ I have improved my school attendance.. 

_ My school attendance^ grades, and behavior are about the same. 
My school attendance, grades, and behavior are worse than befor 



7i WhaU are some* good things about this school? 



8. How could this school be improved? 



Thank you for your comments. 
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TEACHER QUESTIONNAIRE 



Dear Teacher: 

The following is the Teacher Questionnaire. Please answer all the 
questions as your responses will be included in the evaluation 
report. To ensure anonymity, do not write your name on this form. 
Thank you in advance for your feedback. 

1. Please list below the curricular objectives you wish to 
accomplish this semester. Place an ''X*' next to each of the areas 
your classes will have covered by the end of this sen^ester. 



Objectives Completed 



a . 
b. 
c . 
d. 
e . 



2. Have you been able to get all the materials you needed? 

Yes 

No 

" ~" " ■ ■ I 

If "NO," pleaae explaii : 



3. Have most of your students enjoyed instruction? 

Yes 

No ~_ 



If NO," please explain: 



U. Appi oximately how often have you had your students write? 
(Please check only one) 
Daily 

Three to four times per week 



One to two times per week 
Not at all 
Not applicable 

1 



ltV7 



5. Approximately how often have you had your students read? 
Daily 

Three to four times per week 

One to two times per week 

Net at all 

Not applicable 

For the following questions, please circle the appropriate number 
that best represents your opinion. (NOTE: SD=Strongiy disagree; 
D«Disagree; U«Undecided; A=Agree; SA^Strongly agree.) 

SD D U A SA 

6. I am satisfied with the facilities in which 12 3 4 5 
I teach, 

7. I enjoy participating in the program. 12 3 4 5 



8. I have good support from the administration 



1 2 3 4 5 



9. Our program offers a quality education with 12 3 4 5 
equity for all students. 

10. There are few student interruptions during 12 3 4 5 
class time. 

11. Special instructional aids for individual 12 3 4 5 
students are integrated with classroom 

instruction and the school curriculum. 

12. Factors outside the classroom rarely 12 3 4 5 
interrupt basic skills instruction. 

13. Typical daily lessons follow this 12 3 4 5 
sequence: teacher presentation, student 

practice, specific feedback, evaluation 
of student performance. 

14. Teachers expect and plan asj;ignments so 1 2 3 4 5 
that students will be highl) successful 

during practice work following direct 
instruction. 

15. Clacs atmosphere is generally very 12 3 4 5 
conducive to learn i.ng for all students. 

16. During basic instruction, students are not 1 2 3 4 5 
working independently on seatwork for the 

majority of the allocated time. 

17. Teachers start classes on time and continue 12 3 4 5 
teaching to the final bell. 



ERIC 



18. What have been the strongest elements of the program? 



19. In what ways should the program be improved? 



20. In your opinion, how successful is the school token economy system' 



Thank you for you comments* If you have any questions or 
additional comments, please contact Mr. DeSouza at 276-1092. 
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